Streaming Failure Recovery: Classify by What EscapedStreaming failure recovery: classify by what escaped The canonical broken streaming client is one catch block around the whole iterator: attempt, yield chunks, on exception start over. The loop tracks3 min read·nrouter.hashnode.dev3d ago
Thin Clients, One Policy: What nRouter's SDK Catalogue Gets RightGateway SDKs usually fail in one of two directions. Either there is one first-class client (for the language the vendor's own team uses) and the rest of the ecosystem is told to speak raw HTTP, or eac3 min read·nrouter.hashnode.dev3d ago
Direct or nrouter/auto: The Model String Is the Whole SwitchDirect or nrouter/auto: the model string is the whole switch Most routing systems accumulate configuration surfaces: a header here, a dashboard weighting there, a client wrapper retrying its way acros3 min read·nrouter.hashnode.dev3d ago
Deny Always Wins: Model RBAC in nRouter's CatalogMost gateway access control is additive: grant a key a set of models, and hope nobody grants too much. nRouter's Models guide documents a stricter shape — allowlists and deny lists at three scopes, wi3 min read·nrouter.hashnode.dev3d ago
LLM Routing with Jev 1.14: Keep the Judgment, Keep the AuthorityLLM routing with Jev 1.14: keep the judgment, keep the authority The useful way to read a judgment model is as a supplier of typed opinions, not as a junior operator. TypeSafe's Jev answers closed que3 min read·nrouter.hashnode.dev4d ago